
STATISTICAL GUARDBAND METHODOLOGY 



Field of the Invention 



This invention relates to methods and systems used to develop guardbands for assessing 
product specifications. More particularly it relates to methods and systems for developing 
guardbands for integrated circuits such as processors which are subject to manufacturing, testing 
10 and environmental performance variations. 



Guardbands are typically used in manufacturing to protect against product and process 
ifj 15 specification variations. However, if a manufacturer is too conservative in setting the guardband 
i f] the amount of good products that fail testing is increased. If the guardband is too narrow, the 
! y products that go to customers may not function as specified. Two articles that discuss 

□ guardbands and the tradeoffs due to guardband placement are The Economics of Guardband 

Ty Placement, Richard Williams and Charles Hawkins, International Test Conference 1993 and The 
1 20 Effect of Guardbands on Errors in Production Testing, Richard Williams and Charles Hawkins, 
~' 4 International Test Conference 1993. 

Js=j Products, especially, integrated circuits, are designed to be used in a number of 

j7j applications. Each application often provides a somewhat different set of operating conditions. 
q To insure that the product can work in each of these applications, manufacturing tests must be 
SJ25 created to test both for these operating components and the surrounding impact of system 

□ components. This could involve a number of variables and parameters. One of the most important 
Q variables for processors is the speed which the processor operates in its system environment. 

Semiconductor manufacturers are constantly changing their designs, application conditions and 
processes to get faster processors. 

30 Guardbands are determined today in a variety of ways. The easiest approach in 

developing guardbands is to develop tests that provide for the worst case of every variable. Other 
approaches include incorporating one of the variables mentioned above (usually test related 
variables) into determining a guardband, guardbanding reliability wear out mechanisms only, 
choosing a guardband to satisfy yield targets or not using a guardband at all. For many products, 

35 especially integrated circuits that are processors, establishing a guardband using these approaches 
can lead to sub optimal results. 



Background of the Invention 
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Summary of the Invention 



Current approaches of setting the same guardband across speed sorts, guardbanding to 
5 worst case application conditions, and ignoring other variables, ends up lowering yields, providing 
fewer high frequency integrated circuits, and more lower frequency circuits. It is an object of this 
invention to provide a method of establishing a product specification guardband that treats 
variables statistically and allows risk level to dictate the appropriate guardbands. 

This invention is a method and system for determining product specification guardbands 
10 that first develops models of each variable that influences the product specification, such as: test 
environment, the test environment to system environment differences, system environment and 
reliability by incorporating these variables into a statistical representation of each. The models 
are then input into a statistical program which performs a Monte Carlo analysis or analytical 
analysis (by convolving statistical distributions) to determine the correct specification guardbands. 

15 

Brief Description of the Drawing s 

20 FIG. 1 is a performance-distribution plot of an integrated circuit. 

FIG. 2 is an example of the output which the guardband determines. 
FIG. 3 is a flowchart illustrating the process for obtaining the model for the system 
environment. 

FIG. 4 is a flowchart illustrating how the system to tester offset is generated. 
25 FIG. 5 is a graph illustrating the distribution of various sample sizes. 

FIG. 6 is a graph illustrating the fail rates due to reliability effects. 
FIG. 7 is a flowchart illustrating the steps for determining a product guardband according 
to this invention. 

FIG. 8 is a diagram that illustrates the typical hardware system used in determining the 
30 guardband. 

Description of Preferred Embodiment(s) 

35 

Determining final product specification guardbands are often the least considered items of 
product development. Yet the guardbands chosen can, and often do, have a major effect on 
product quality, revenue and yield. This is especially true when "deep sorts 1 ' exist. See the upper 
tail of the product performance-distribution plot of FIG 1 . Many factors compound the deep sort 
40 guardband complexity, and guardband choice may eliminate sort based on small area at tail 2 of 
the distribution. A slight change in guardband can affect a large portion of parts due to large area 
under performance distribution curve of FIG. 1. Yet customers desire the highest performing 
parts. Slower performing parts are usually less susceptible to reliability mechanisms. 
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This invention incorporates market sector tolerance targets ( quality and reliability) and 
models representing key variables that affect the product in the target market sector. It then uses 
these factors to produce a final product specification guardband using a Monte Carlo analysis. For 
the described embodiment, these variables are: tester environment, system environment, 
5 system-to-tester offset and reliability wearout mechanisms. Each statistical model will first be 
described followed by the description of the overall method and system. 

Product performance or maximum frequency (FMAX) will be used to describe the invention 
because it is a critical specification in described embodiment which is built around the testing of 
integrated circuits, particularly processors. However it should be obvious to those skilled in the 
10 art that this methodology could be applied to other product specification such as but not limited 
to: the minimum / maximum operating voltage of a product, the minimum / maximum operating 
temperature of a product, minimum / maximum operating power of a product, minimum / 
maximum sleep mode power of a product, access time for memory products, or any key product 
specification. 

1 5 For processors, FMAX, the maximum frequency that the integrated circuit will operate in the 
system environment, is important in terms of the application and price at which the processor will 
be sold. As a result of process variation, each processor has a different FMAX. Measuring 
FMAX and sorting a processor by performance is accomplished by running a set of functional 
test patterns at the desired sort frequencies. A processor is binned at the highest sort frequency in 

20 which all patterns function. Generally, the FMAX of the processor as measured on a tester is 
faster than the FMAX of the processor as measured in a system. 

The tester environment is one input to the guardband model. Tester characterization 
involves quantifying those variables that may contribute to inaccuracies in a product specification 
(i.e. FMAX) measurement on a tester. These include contributions such as: tester timing 

25 accuracy, clock edge placement accuracy, power supply distribution, temperature distribution and 
tester-to-tester offset. The error in FMAX can be broken up into two components, one 
mechanical and one electrical. The mechanical component contains the DIB (device under test 
interface board) and handler, and the electrical component focuses on the pin electronics of the 
tester. Both components add to the inaccuracy in the FMAX measurement. The FMAX errors 

30 are then characterized, and a model is developed using a statistical programming tool. SAS by 
SAS Institute, Inc., a commercially available statistical programming tool, is suitable for such use, 
but other programs could be used as well (i.e. MATLAB by Mathworks, Inc., MATHCAD by 
MathSoft, Inc.,etc). 

35 
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System environment characterization involves quantifying those variables that may 
contribute to inaccuracies or anomalies in a product specification (i.e. FMAX) in a system. 
These include such application conditions as compatibility with different components, assessing 
effects of manufacturing process variation, temperature variation, power supply variation and 
5 noise margin. 

In FIG. 3 the process for obtaining the model for the system environment is illustrated. In 
order to obtain the data for this characterization various system environments are setup at step 21 
for product measurements. A typical setup would include a means of varying system frequency 
(i.e. external oscillator), a means of varying power supply voltage (i.e. voltage regulator), 
10 temperature controller (i.e. Peltier device) and a means of inserting various samples into the same 
board (i.e. a socket). Since not all parts run at their specified voltage/temperature, system power 
supply and temperature are statistically modeled at step 23 using various samples under normal 
operating conditions. These models provide a means of predicting a particular voltage and 
temperature value for any given processor operating at any given time. Next at step 25, the 
iH 15 system is initialized (desired operating temperature, voltage and PLL mode are selected). The 
\Z variable oscillator is then set to a low value and at step 27 the processor is booted at a slow 
ry frequency. At step 29 the frequency of the oscillator is increased in fixed intervals until the system 
; J { no longer boots. The processor is rebooted at the frequency the system hanged. If the system 

boots, it is exercised using an intensive and comprehensive suite of software packages. If the 
|3 20 processor could not run the complete software suit successfully, the oscillator frequency is 

lowered at step 35 until the processor boots and the software verification testing at step 3 1 is 
SI repeated. If the processor booted and ran all software without hanging, the FMAX is recorded at 
;~ ' step 33. This process is repeated at step 37 for another voltage, temperature, PLL mode or 
processor. When process is complete, the FMAX data for the system environment are 
25 characterized at step 39 and included with the tester models. 

Once product FMAX data is collected on a given number of integrated circuits, both on a 
testermW-k^asystem, that data can be analyzed to determine the system-to-tester offset model. 
Based on various^r©4ucts studied, in gathering system and tester data best results occur by 
sampling at least 15 to 20pi s t)e$ssors per performance sort generated. At step 50 the system and 
30 tester FMAX data is input into thesteti§tical software program. At step 52 a system-to-tester 

rFMAX delta is calculated. This delta at step^^tested for best distribution type (typically, the 
distribution is Gaussian). Based on best distribution ifit^aMtep 58 distribution parameters are 
calculated based on sample size and confidence selected at step^60u(fbr Gaussian distribution, 
population mean and standard deviation are estimated). For a Gaussiaivatstcibution, a 
35 t-distribution is used to estimate population mean and chi-squared distribution isitse^to estimate 
population standard deviation. These results are output to the Monte Carlo routine at step^2. 
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This process is repeated through step 64 for each performance sort or system under analysis 
until process is completed at step 66. 

Reliability wearout mechanisms are estimated using both technology models and product 
specific data ( power on hours, use voltage, use temperature, etc.). Depending on the wearout 
5 mechanism, different parameters will drive guardband. In the case of processor's hot electron 
(hot-e) degradation is an important specification. However, this technique could be extended to 
cover other reliability wearout mechanisms (i.e. SER, electromigration, etc.). A hot-e guardband 
model is developed using technology models (design manual equations, circuit models, etc.) and 
product specific variables such as operating voltage, operating temperature and average channel 

10 length per speed sort. This model predicts performance degradation at end of life. Hot-e is 
primarily driven by high voltage and short channel length. As illustrated in FIG. 6 fail rates 
increase on axis 15 with frequency (shorter channel lengths) and on axis 13 with voltage. This 
reliability data is characterized by the statistical software program to form a reliability model. 
As illustrated in FIG. 7 the models previously described denoted as blocks 1 10, 120, and 

15 13(T^P€^inputs to the Monte Carlo analysis as well as market sector quality (i.e. SPQL) 
expectations s deoj)ted as block 140. Each model is incorporated using the distribution type 
determined during the^aftqlysis previously described. A loop value is set (shown as 10,000, in 
block 150 but can be any relatfreljHarge number). Each model contributes a value at step 160 
which is randomly selected based on ahtqbution type. One guardband value is determined by 

20 combining the individual values and then addihghot-e input based on performance sort. This is 

(/l repeated through steps 180, 190 and 170 until thetbeto value selected in block 150 is reached. 

Y The output is a distribution of guardbands based on all fiibiQrs previously discussed. Finally, 

depending on market quality expectations input at block 200/Vguardband can be selected at 210 
which intelligently satisfies market tolerance expectations while mimrrtizjng yield loss (See Figure 

25 2). As can be seen from Fig. 2, trimming a few percent off a guardband , shcrwrn as vertical axis 4, 
to make yield targets without understanding the effects on product quality may aclv^rsely effect 
product quality. The opposite holds true as well. Over-guardbanding can lead to quality^evels 
not required in the market which can in turn adversely affect yields and revenue. 

As mentioned earlier any statistical software program can be used with the invention. S AS 

30 is used in the current implementation, but other programs are just as good (i.e. MATLAB, 
MATHCAD, etc.). One also uses these statistical software programs when determining the 
"critical specification" probability statistics. You also use the statistical software for running the 
Monte Carlo analysis for determining the final guardband. 

35 
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FIG. 8. illustrates the typical hardware configuration of a computer system capable of 
creating the test guardband in accordance with the subject invention. The configuration 
comprises at least one processor or central processing unit (CPU) 10. CPU(s) 10 is 
interconnected via system bus 12 to a random access memory (RAM) 14, read-only memory 
5 (ROM) 16, an input/output (I/O) adapter 18 for connecting peripheral devices such as disk units 
20 and tape drives 40 containing a statistical program capable of doing statistical distribution 
analysis to bus 12, user interface adapter 22 for connecting keyboard 24, mouse 26, speaker 28, 
microphone 32, and/or other user interface devices such as touch screen device (not shown) to 
bus 12 for inputting data such as tolerance data, communication adapter 34 for connecting the 
10 information handling system to a data processing network and for inputting various 

environmental models into the computer the models, and display adapter 36 for connecting bus 12 
to display device 38. The variable inputs shown on FIG. 7 and the SAS software are loaded on 
^ the appropriate disk or tape units or fed either through I/O adapters or the network for 
\% processing. A computer program with an appropriate application interface could be created by 
l Jl 1 5 one of skill in the art and stored on the system to simplify the practicing of this invention. 
'X Although this disclosure identifies a preferred embodiment, it should be noted this system 

|1J could be easily extended to enable quantifiable business decisions which maximize revenue while 
If: not sacrificing quality when considering variables that affect products or process specifications by: 

implementing other analysis methods, including other variables that affect maximizing revenue 
]=i 20 while balancing risk and also applying this system to other applications within and outside the 
;5 semiconductor industry. 

i l 
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